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t 1. Prove that finding the maximum intensity value in a digital image is a nonlinear operation 


w -2. Image filtering using the median of the pixel neighborhood is useful in removing certain kind o 
noise. The median, { , of a set of numbers is such that half the values in the set are below ? and 
the other half are above it. For example, the median of the set of values {2, 3, 8, 20, 21, 25, 31} is 
20 . 

a) Show that an operator that computes the median of a sub-image area, S, is nonlinear. 

b) Is it possible to apply the median on images using a mask and the correlation? Why? 


3. Imaging under very low light levels causes the imaging system sensor noise largely affects the 
resulting images. Let fl(x.y) denote ^corrupted image formed by the addition of sensor 
noise: rj(x,y) to the scene noiseless image f(x,y)', that is g(x, y) = f(x,y) + r?(x. y) ■* ,n 3 
process of noise reduction, a set of noisy images {tfjtx.y)} for the same scene are averaged to get 
a less affected by noise image. Assume that at every pair of coordinates (x,y) the noise m the 

added images is uncorrelated and has zero average value. 

a) Prove that the expected value of the image formed by averaging K different noisy images 



is the noiseless image f(x,y) 

b) How the variance and the standard deviation of the average image is related to the 
variance and the standard deviation, respectively, of the noise. 

c) Mention the condition that must be satisfied when practically applying the process for 

reducing the noise 


4 . 


\ 5. 


Image subtraction is used often in industrial applications for detecting missing components in 
product assembly. The approach is to store a "golden" image that corresponds to a correct 
assembly this image is then subtracted from incoming images of the same product. Ideally, the 
difference would be zero if the new products are assembled correctly. Difference .mages for 
products with missing components would be non-zero in the area where they are differs from the 
golden image. What conditions do you think have to be met in pra^cejoahis^method to work? 


Consider two 8 bit images whose intensity levels span the full range from 0 to 255, Discuss the 
limiting effect of repeatedly subtracting imagej from image 1. Assume that the result also is 

represented in 8 bits 


6. For the figure shown, sketch the set A 0 B) U (A U B) 
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Sheet 4 solution 


1. An operation H on a digital image f(x, y) is linear if and only if it satisfies two conditions. 
f{[af(x,y)\ = a//[/(x,>0](horrK>genei ty).and 

H[uJ l (x,y) + a l f J (x,y) = a,//[/;(x,>')]+a / //[/' / (ac,>'](superposiion) / 

Then one example that demonstrates that one of these conditions is not applicable for a given 
operation is sufficient as a proof for the nonlinearity of the operation. Here is an example that 
demonstrates the violation of the superposition for the maximum pixel value operation. 



SB -2 


Maxi ( 1 ) 


= Max 


while 


(1 )Max 


= 3-7 = -4 

Hence, in gjneral the operation is nonlinear 



11 1 

‘6 sT 

U(-l)Afej 

. 4 7 J 


2. a) 

The median of a sub image is a linear operation if and only if 
Median[axfi(x,y) + a 2 f 2 {x,y )] = a, Median[fx (x,y)) + a 2 Median[f 2 (x,y)] 
For any real constants a! and a 2 , where fiand f 2 are any two sub-images. 


(1) 


let fx = 

Median[fx(x,y)\ = 7. 


3 4 3 

4 8 7 
9 8 9 
Median 


. and f 2 = 


2 

3 

0 


ZzU.y)] = 1 , let a, = 1 and a 2 = -1 
LHS of (1): a x Median[fx(x,y)] + a 2 Median[f 2 (x,y )] = 7-1 = 6 

n 2 3i 

RHS of (1): Median[axfx(x,y) + a 2 f 2 (x,y )] = Median 


5 

8 


= 5 * LHS 


So, the median operation is not linear 
b) 

NO. A mask and correlation is used in linear filtering only and cannot be used to apply nonlinear 
operation 


3. (a) 

The average at any pair of coordinates (x,y) of a set of K images is given by 
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1 K K ^ K 

§(x. y) = kYj 9i (x ' = x ^ fi (*• y) + k Yj m (x ' y) 

i=l i=i „ ‘=1 

I K i K > 

Applying that the expected value of the sum is the same as the sum of the expected values of the 
items included in the sum 


E{sOT3o) = ^E{/,(*.y)) +i]j>/(’>((*.y)} 

The expected value of a constant is the constant itself. This fact applies on /, (x, y) since the va 
of the original image is always the same; that is a constant. Another probability rule says t at 
expected value of a random variable of a given mean is the mean itself. This rule applies on 
riifx. v'l that has a zero mean as stated above. Hence, 

E{g(x.y)}- fix.y) 


lb) 

Restarting from the equation 

S(x.y) = ^9i (*.y) - 7 £A<*.y) + *^> 

It is known from random-variable'theory that the variance of the sum of uncorrelated random 
variables is the sum of the variances of those variables. In addition, the variance of a constant 
value ftix, y) is zero. Then, we can write 

o 2 gfcy) ~ + j<2 l rT %i(*.y) + ff 2 iji(*.y) + *“ + a 2 nir(*.y)] 

= ^7 [ <j2 i7i(».y) + + *" + <TZ 'ix(ry)] 

But n are samples of the noise tj that has a single variance which is <x rj (x,y)* Hence, 

2 _ * . 2 . _ 1 2 

a fl(xo') “ x 2 *>(*.y)/ ~ k c n(*.y) 

The relation of standard deviation is obtained by just taking the square root of both sides in the 
above equation. 

a gUy) ~ ^ a v(x,y) 


(c) 

The condition that must be satisfied when practically applying the process is that the image to be 
averaged must be registered (aligned) in order to avoid the introduction of blurring and other 
artifacts in the output images 


4. Let# (x,y ) denote the golden image, and let /(x, y ) denote any input image acquired during 
routine operation of the system. Change detection via subtraction is based on computing the 
simple difference d(x,y) = g (x,y) - /(x,y). The resulting image, d (x,y ), can be used in 
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two fundamental ways for change detection. 

One way is pixel-by-pixel analysis. In this case, we say that / (x,y ) is "close enough" to the golden 
image if all the pixels in d (x,y ) fall within a specified threshold band [T m m,Tmax ] where T mtn is 
negative and is positive. Usually, the same value of threshold is used for both negative and 
positive differences, so that we have a band [~T,T\ in which all pixels of d (x,y ) must fall in order 
for / (x,y) to be declared acceptable. ... 

The second major approach is simply to sum all the pixels in d (x, y ) and compare the sum 
against a threshold Q. Note that the absolute value needs to be used to avoid errors canceling out. 
This is a much cruder test, so we will concentrate on the first approach. 


There are three fundamental factors that need tight control for difference based inspection to 
work: 

% * • 

(1) Proper registration 

(2) Controlled illumination 

(3) Noise levels that are low enough so that difference values are not affected appreciably by 

variations due to noise. t 

The first condition basically addresses the requirement that comparisons be made between 
corresponding pixels. Two images can be identical, but if they are displaced with respect to each 
other, comparing the differences between them makes no sense. Often, special markings are 
manufactured into the product for mechanical or image-based alignment. 

Controlled illumination (note that "illumination" is not limited to visible light) obviously is 
important because changes in illumination can affect dramatically the values in a difference 
image. One approach used often in conjunction with illumination control is intensity scaling based 
on actual conditions. For example, the products could have one or more small patches of a tightly 
controlled color, and the intensity (and perhaps even color) of each pixels in the entire image 
would be modified based on the actual versus expected intensity and/or color of the patches in 
the image being processed. 

Finally, the noise content of a difference image needs to be low enough so that it does not 
materially affect comparisons between the golden and input images. Good signal strength goes a 
long way toward reducing the effects of noise. Another (sometimes complementary) approach is 
to implement image processing techniques (e g., image averaging) to reduce noise. 

Obviously there are a number if variations of the basic theme just described. For example, 
additional intelligence in the form of tests which are more sophisticated than pixel-by-pixel 
threshold comparisons can be implemented. A technique used often in this regard is to subdivide 
the golden image into different regions and perform different (usually more than one) tests in 
each of the regions, based on expected region content. 


5. (a) 


Pixels are integer values, and 8 bits allow representation of 256 contiguous integer values. In our 

work, the range of intensity values for 8-bit images is 10,255]. The subtraction of values In this 
ie range l~25S,255]. This range of values cannot be covered by 8 bits, but it is given 


consistent wi< 


m statement that the result of subtraction has to be represented in 8 bits also/and, 1 
it i t e range of values used for 8-bit images, we assume that values of the 8-bit 
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difference images are in the range [0,255]. What this means is that any subtraction of 2 pixels that 

yields a negative quantity will be clipped at 0. _ 

The process of repeated subtractions of an image 


from an image a{x,y ) can be expressed 


K 

d k (x,y) = n(-Y.y) ~ ^ 

V 


HaH 

Where d* fx,y ] Is the difference ^a^^ r ®^u^^g^^er K^ubtrart^ons. the subtraction of any 
an array operation (see Section • ^ ^ a)ready stated that nega tive results are 

corresponding pair of pixels in the .mag . ^ because subtraction of any nonnegat.ve 

clipped at 0. Once a 0 result is obtain* j. ' ls c i ippe d at 0. Similarly, any location (x 0 , Y o) for 

value from 0 is a negative quantity wh , g , repeatedly subtracting 0 from 

which bfx 0 ,Vo)= 0. are not 0 will eventually decrease the 

any value results in that va u . are Q The maX j mu m number of subtractions m w ic 

corresponding values in * f X ;V prese nt problem is 2S5, which corresponds to the condition 

this takes place in the context o i ihe r P ) ^ Thu$ we conc|ude from the preceding 

at a location in which ax * * J age from another w,i. result m a difference .mage 

discussion that repeated^ subtract ^ & xy ) that afe not * e ro and equal to the ong.nal 

whose componenu are^^ o n ; .; ^ y ) ^ ^ Q Tht$ result wlH be achieved In, at most, 255 

values ot 

subtractions. 

6. fa) 
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by averaging is an application ol image addition, especially in astronomy, 
nder very lav. light level frequently causes sensor noise render single image 
for analysis Averag.ng a number of images taken for the same s 
it level reduces the nois<r contents In the average image As the numt 
increases a; the he resulting average image decreases. 
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b ' mod™ a S r s ! :zz?r : an t am ° f ,maee ■**««• »** 

region of the patient's bodv The nrn h ' racUon A mask h|x • vl 's an X-ray image of a 
into the patient's bloodstream lei ' ure COhslsts of injecting an X-ray contrast medium 
region as ,h« ni k. ? \ ' lakm8 a Series of ‘™8« “"<* * 'mages of the same 

after iniection Of \ sub,ract,n 8 < he mask (romthe series of incoming live images 
saLT aS ' med ' l,m ' Thl »' subtracting the mask from each 

sample Irve image is that the areas under that are different bet»ee~thTilve iStagTSSa 
™ e mask appears in the output image enhanced. 




